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Abstract 

Correction  terms  are  obtained  for  the  diffusion  approximation 
to  one  and  two  barrier  ruin  problems  in  finite  and  infinite  time. 

The  corrections  involve  moments  of  ladder  height  distributions,  and  a 
method  is  given  for  calculating  them  numerically.  Examples  show  that 
the  corrected  approximations  can  be  much  more  accurate  than  the 
originals. 


Key  Words  and  Phrases:  Diffusion  approximation,  heavy  traffic, 
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CORRECTED  DIFFUSION  APPROXIMATIONS 
IN  CERTAIN  RANDOM  WALK  PROBLEMS 


1.  Introduction  and  Summary 

Let  be  independent  and  identically  distributed 

with  mean  y = E(x  ).  Let  s = x,  + ...  +x  , and  for  a < 0 < b define 
1 n 1 n — 

the  stopping  times 


T = T (b)  = inf{n  : s > b}  (t  = t(0)) 
n + 


and 


T = T(a,b)  = inf {n  : s t [a,b]}  . 

n 

The  probabilities 

(1)  P{t<°°} 
and 

(2)  P{sT>b} 

as  well  as  their  "finite  time"  analogues 

(3)  P{t  £m} 
and 

(A)  P{T<m,  sT>b} 

arise  in  a wide  variety  of  contexts  including  insurance  risk  theory, 
queueing  theory,  storage  theory,  and  sequential  statistical  analysis. 

One  very  simple  and  useful  approximation  to  these  probabili- 
ties is  the  so-called  diffusion  approximation  (in  queueing  theory — a 
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"heavy  traffic"  approximation).  In  which  the  discrete  random  walk  is 
replaced  by  an  appropriate  Brownian  motion  process,  for  which  (l)-(4) 
may  be  computed  exactly.  A defect  of  this  approximation  is  that  in 
many  cases  it  is  not  sufficiently  accurate;  and  a variety  of  methods, 
both  theoretical  and  numerical  have  been  suggested  as  alternatives  in 
various  special  cases. 

One  alternative  which  deserves  particular  attention  is  the 
beautiful  result  of  Cramer  as  extended  by  Feller  (see  Feller,  1966, 
pp.  363  and  393)  that  as  b + “ 

(5)  p{x  < oo}  ..  Ce"Yb  . 

Here  f (X)  = E exp(Xs^)  is  assumed  finite  and  y is  the  positive  value 

(assumed  to  exist)  for  which  f(y)  = 1.  One  difficulty  in  using  (5) 

is  determining  C,  which  in  general  is  a fairly  complicated  functional 

of  the  distribution  of  s^  . Often  it  can  be  computed  numerically. 

(See  Woodroofe,  1978,  for  the  first  general  results  in  this 

direction.)  This  approach  seems  to  be  less  successful  in  dealing 

with  (2),  (3),  and  (4),  although  some  results  have  been  obtained  by 

Borovkov  (1962),  von  Bahr  (1974),  and  Siegmund  (1975a, b). 

The  purpose  of  this  paper  is  to  suggest  usable  approximations 

to  (l)-(4)  and  related  quantities  by  computing  correction  terms  in 

the  diffusion  approximation.  These  correction  terms  involve  moments 

of  s , and  a number leal  method  for  computing  them  is  described. 

T+ 

The  paper  is  arranged  as  follows.  Section  2 discusses  the 

simpler  problem  of  approximating  E(sup  sn)  * J^°  P{x(b) < °°}db,  which, 

n 

however,  already  involves  the  most  novel  mathematical  results 
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(see  especially  Lemma  4).  Section  3 is  devoted  to  (1)  and  (2)  and 
Section  4 to  (3)  and  (4) . The  treatment  in  Section  4 uses  Laplace 
transforms.  Although  formal  inversion  of  the  transforms  is  easy  and 
yields  what  appear  to  be  useful  approximations,  a rigorous  justifica- 
tion of  the  inversions  remains  an  open  problem.  Section  5 discusses 
numerical  evaluation  of  the  constants  entering  into  the  corrected 
approximation.  Section  6 contains  numerical  examples.  The  prac- 
tically oriented  reader  may  wish  to  read  these  sections  in  the 
reverse  order. 

A result  closely  related  to  Theorem  2 of  Section  3 was 
obtained  by  completely  different  methods  by  Borovkov  (1965). 

The  following  notation  and  assumptions  are  used  throughout. 
Assume  that  for  6 in  some  open  interval  containing  0,  under  P_, 

xi,x2 are  independent  random  variables  with  probability  density 

function 

(6)  exp{0x-^(0)} 

relative  to  some  non-arithmetic  measure  F.  (For  arithmetic  F 
analogous  but  slightly  different  results  are  obtained.)  The  function 
ij;  is  normalized  so  that  ij^(0)  = <|>'(0)  = 0,  if<"(0)  = 1,  and  then  F is 
the  Pq  distribution  of  x^.  It  is  easily  verified  that 

1P'(0)  = E0(x1)t  f(9)  = var0(Xl)  , 

and 

E0xi  < , « , or  > 0 according  as  0 < , = , or  > 0 . 
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The  function  ip  is  convex  and  hence  to  small  6 f 0 there  corresponds 


exactly  one  0^0,  necessarily  of  opposite  sign,  for  which 

<K0)  = <K0)-  It  will  be  convenient  to  think  of  0Q  < 0 as  given  and 

©1  > 0 defined  by 

(7)  <K0O)  = *(01)  , 

although  this  relation  might  well  be  reversed. 

Let  be  the  restriction  of  Pg  to  the  space  of  x^,...,xn> 

so  that  by  (6),  for  all  0'  and  0" 

(8)  dp^}  - exP{(0’  -0")sn  - n[l|>(e,>-¥(e,,)]}dP$J)  . 


In  particular,  by  (7) 


exP{(01-0O)sn}dPr 


The  following  version  of  the  fundamental  identity  of  sequential 
analysis  will  be  used  repeatedly. 

Lemma  1.  Let  o be  a stopping  time  and  f a non-negative  random  vari- 
able such  that  for  all  n = 1,2,...,  fl{amn}  is  3 function  of 
x^,...,xn  (and  not  xn+^,...,  ).  Then  for  any  pair  0',0" 

/{a«»}  fdV  = /{o<co}  f exP{(0'  " ®")8a  “ 0 W,(0')  ~ ♦(6")  ]}dP0tl  . 


The  proof  follows  at  once  by  writing  ^{0<00j  “ ^{o»n}  and 


using  (8). 
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2. 


(sup  s ) 
0 n>0  n 


The  following  result  is  elegant  and  Illustrates  the  basic 

mathematical  techniques  of  this  paper.  The  proof  of  Lemma  4 seems 

particularly  interesting.  Recall  that  T = inf{n  : s >0}.  It  will 

“t  n 

be  convenient  to  use  the  notation  A = G,  - 0_  and  W = sup  f.  . 

1 0 n 

n>0 

Observe  that  as  0^  t 0,  0^  I 0 and  hence  A 0. 


Theorem  1.  As  0^  t 0 


(9)  Efl  W = A' 
90 


and 


E„s2 

1 °T+  4 

r Ens3 

1 0 T+ 

'<  fl 

2E0s  2 

L3  Eo% " 

2Eo%  / J 

+ o(A) 


(10)  E„  W = 2A 
90 


E s2  / E s2  \ 2 

-2  .-1  0 V , f °V  ) 

A E s 2E  s I + ° 

0 T+  \ 0 T+  I 


(1) 


Proof . Let  denote  the  nth  increasing  ladder  epoch  (t£^=t+). 

Let  p = F„  {t  < oo}  and  £ = EQ  (s,.  It,  < °°) . Then  from 
90  + 90  T+  + 

Pg  (w  > x}  = E Pg  {t^C00,  ST(n)>X,  T|n+1^=°»} 


w 

= (1-p)  E P {r|n)  <co,  s(n)>x) 
10  T+ 

follows 
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E„  W = (1-p)  E pn  r (s(n)|T(n)<oo)  = (1.p)Upn^  = pC/(l-p) 

^ 1 "A  l I ' 


Je 


o 


o + 


Hence  by  Lemma  1 


(11) 


E 0 [s  exp  (-As  ] 
X "I"  *4" 

VW  1 ~ E0  exp(-AsT  ) 


0 


It  follows  from  Taylor  series  expansions  that 


E01  [sT+  exP(-&ST+)1=  E01  st+  - A E01  \+  + I A2  E0  s3+  + 0(A3) 


and 


l-\  “P<-Ast+>  -H,  st+  - 1 *2  \ »?+  + | 43  ^ + 0(fi4) 


Substituting  these  expressions  into  (11)  and  expanding  yields 

2 . 2 

“a  C<Q  a_  / C.Q  r 

. Av  „ ei  T+  . / 6 1 


2 3 

EQ  s A Eq  s / E.  s' 

(12)  E ♦0«2>  . 

1 0,  t.  e,  t. 


'1  '+  "1  l+ 


2 Eq  s 
el  T+ 


By  Lemma  2 below 


(13) 


Eq1%  = v;+  + eik  Eo-r/(k+i)  + °(A) 


k+1 


Observing  that  A ~ 2^  and  substituting  (13)  into  (12)  yields  (9). 
The  proof  of  (10)  is  similar  and  has  been  omitted. 


Lemma  2 . For  each  k > 0,  as  0^  I 0 


k k k+l 

ST  = Vt  + 8lk  Vt  /(k+1)  + °(01)  ' 


Proof.  From  the  representation 


E0sk  = EQ{sk  expr0sT  -T+iK9)]} 
•f  + + 


and  the  dominated  convergence  theorem  it  is  easy  to  see  that 


, . _ k _ k 

lim  Eqs  = E s 

0+0  0 T+  0 T+ 


This  representation  also  shows  that  f ( 9)  = 
ferentiable  on  (0,e)  for  some  e > 0 and 


E„s  is  continually  dif- 
0 T+ 


f’(0)  = E [s*  (s  -yx  )]  , 

+ + 


where  y^  = (0)  = E^x^.  be  shown  in  Lemma  4 below  that 


k k+1 

lim  y Efi  X s = E s /(k  + l)  . 

0+0  0 T+  U T+ 


Writing 


f(61)  = f (0)  + (01-0)f,(0)  + /Q  1[f'(y)  - f*(0)]dy 


letting  0 -*•  0,  and  appealing  to  (14)-(16)  completes  the  proof. 

Let  <f>(x)  = (2tt)  ^ exp(-  ^ x2)  and  4>(x)  = fx  <Ky)dy.  For 
t >0,  - oo<^<oo>  and  c > 0 let 


G(t;F„c)  = 1 - 4»(ct_ii-  CtS  + e2^C  4>(-c  t"*1  - f.t5*)  . 
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f 


I 


—1  X 

Let  H(x)  = (eqst  ) Sq  Pgl  ST  >y)‘ly.  It  follows  from  the  invariance 
principle  of  Erdos  and  Kac  (1946)  that  if  b 00  and  0 -*•  0 such  that 
0b  -*■  £ € (-00,00) , then 

(17)  lim  Pg{lf.h2t}  = G(t;£,l)  (0<t<°°)  , 

or  equivalently 

(18)  lim  Eg  exp(-At/b2)  = exp{- [( 2A  + £2)^  - £] ) 

uniformly  in  A > 0.  From  consideration  of  the  renewal  process  defined 
by  the  increasing  ladder  heights  and  the  renewal  theorem  (e.g.. 

Feller,  1966,  p.  354),  it  follows  that 

(19)  lim  P {s  -b£x}  = H(x)  (0  < x < °°) 
br*»  U 

The  next  lemma  extends  (19)  to  the  case  0b  -*■  £ > 0 and 

2 

establishes  the  asymptotic  independence  of  s -b  and  t/b  . For  the 

T 

case  0 = 0 it  was  stated  by  Siegraund  (1975b).  The  method  of  proof  is 
a modification  of  the  argument  of  that  paper. 

Lemma  3 . Let  0 > 0.  Suppose  b ■+■  00  and  0 -*■  0 in  such  a way  that 
0b  -*•  £ £ [0,°°) . Then 

(20)  lim  Pg{x<b2t,  sT-b<x}  = G(t;£,l)  H(x)  . 

2 

Proof . Let  m = [b  t ( [• ] = integer  part). 

(21)  Pg{t(b)>m,  ST^-b<x) 

= io.co)  P0{T(b)>m’  Smeb'dy}  Pe{sx(y)“ylx}  • 


8 


I 

I 


Consider  splitting  the  integral  in  (21)  into  three  pieces  according 
as  0 £ y < eb,  £b  £ y £ b/e,  or  b/e  < y < <*>,  where  0 < e < 1 is  given. 
Tt  follows  easily  from  the  central  limit  theorem  that  as  b + ® 
lim  P0{t (b)  > m,  b(l  - £)  < s < b)  < lim  PQ{b(l  - e)  < s < b}  < const,  e, 
so  the  first  integral  is  small  provided  e is.  Similarly,  the  integral 
over  b/e  < y < °°  may  be  shown  to  be  small  for  sufficiently  small  e and 
all  large  b.  Consider  first  the  case  0=0.  Then  by  (19),  over  the 
range  £b  £ y £ b/e  the  integrand  in  (21)  converges  uniformly  to  H(x), 
which  together  with  (17)  completes  the  proof  in  this  special  case. 

By  Lemma  1 

(22)  P0{sT(y)  - y£x}  = e°y  / exp{0  fst(y)  - y ] - x(y)i|;(0)  }dPQ  . 

[ST(y)"y-x} 

Also,  i/j(0)  ~ 0^/2  (0-*-O).  Hence,  by  (22),  (18)  with  0 = 0,  and  the 

special  case  of  (20)  with  0 = 0 one  obtains 

VsT(y>  ~y£*}  = H(x) 

uniformly  in  be  £ y £ be  Repeating  the  first  part  of  the  argument 
with  this  strengthened  form  of  (19)  completes  the  proof  in  the  general 
case. 

If  Xl 

Lemma  4.  lim  y„  Efi  T s = E s /(k  + 1)  (k  > 0) . 

010  0 T+  U T+ 

Proof . For  0 > 0 

OO  OO 

UE0(ts^')=pZ  / s^dPfl  = y£/  E [s  . v-x]kpfl{x  > n,  s € - dx) . 
0 + T+  n=0  (T+>nl  T+  0 0 [0,»)  6 T(X)  9 + n 
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Let  M = min  s , and  let  denote  the  rtJl  weak  descending  ladder 

0<n<°°  n 

epoch.  Then 


Zn  P0fT+>n-  Sn<-X}  = Zn  P0{sn-sklOV°lk£n«  sn<  "x} 

n=0  n=0 


E E Pfl{T^  = n,  s < - x} 
n=0  r=0  0 n 


E0  T+  rfQ  P0{T^r)  < sx(r)  < ' x}P0(T-  = °°} 


V+  rf0  P0(T-r)<“  ST(r)<x’  ^r+1)=»} 


E0T+VM<-x}  • 


Here  the  third  equality  follows  from  the  well-known  identity 

E, 

identity  and  Lemma  1 


qT+  = 1/Pq{t  = °°}  (cf.  Feller,  1966,  p.  379).  Hence_  by  Wald's 


(23)  „ E9(t+  sTk+)  - E„  sT+  '0  ^VST(*)  -*1"  P0{M€-d’'> 


Ee  % {0,.)'o'fsT(x/e)-«/el 


exp  f®(sT(x/0)  - x/0)  - <P(9)t(x/9)  l)eX  Pg{M€-dx/0} 


By  the  renewal  theorem,  (18)  with  0 = 0,  and  Lemma  3 
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(24)  elo  E0^St(x/6)  _x/0  |k  exp^e(sT(x/0)  _x/0)  - <K0)t(x/0)  ]} 

= e~X  E sj!+1/(k+l)  E s . 

Moreover,  an  examination  of  the  proof  of  (24)  shows  that  the  indicated 
convergence  holds  uniformly  in  [f,£  1 ] for  each  £ > 0,  and  the  expec- 
tation on  the  left  is  hounded  uniformly  in  x and  (small)  0.  An  easy 
argument  based  on  Lemma  1 (cf.  Section  3,  especially  (25))  shows  that 

pe{M<-x/0}  e"2x  (x>0)  . 

Also  for  sufficiently  small  0 

Pg{M<-x/0}  < exp(- 3x/2) 

Hence,  partitioning  the  range  of  integration  in  (23)  into  [0,e), 

[e,£  M,  and  (e  *,°°),  and  substituting  (24)  yields 

lim  u E (t  s*  ) = (k  + 1)'1  En  s^+1  / 2e“2x  dx  , 

y + T+  0 T+  [O.oo) 

which  completes  the  proof. 

3.  PQ  {t<°°}  and  PQ  {s  > b} 

90  90  T 

Suppose  that  b -*•  °o  and  0^  + 0 in  such  a way  that  b0g  - £ < 0 . 
Then  b0^  -*■  £ and  bA  = b(0^  - 0^)  -*■  2£.  From  Lemma  1 and  a Taylor 
expansion  it  follows  that 
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(25)  P0  = e E r,  exp  [~A(s  - b)  ] 

60  91  T 


= e~Ab[l- A Eq  (sT-b)  + -|  A2  Eg  (st  - b) 2 + 0(A3)  ] 


By  Lemma  1 


E0  (sT-b)  = Eg{ (s^.  - b) exp  [0^  - (0l) 


By  Lemma  3 and  a uniform  integrability  argument 

E0{(sx-b)exp[ei(sT-b)  -Ti/»(01)]}  - e~^  EQ  s2  /2EQ  st  , 
so  by  (25) 


P0  = e Ab  [l  - A Eg  s2  /2eqst  + o(A)] 


It  will  be  notationally  convenient  to  put 


6 - *0  ST  12  E0ST 

+ + 


Since  the  factor  l-BA  + o(A)  in  (26)  arises  from  expanding  an  exponen- 

-BA 

tial  function  and  since  l-8A  + o(A)  = e +o(A)  as  A + 0,  it  seems 
plausible  that  a better  numerical  approximation  might  be  provided  by 


taking 


PQ  (t  < “>}  » e 

eo 


-A(b+B) 


It  is  the  content  of  Theorem  2 below  tha;  under  slightly  stronger 

assumptions  the  approximation  (28)  is  valid  up  to  terms  which  are 
2 

o(A  ) rather  than  the  o(A)  provided  by  (26)  . 


Let  >(A)  = f ^ e*  X G(dx)  denote  the  characteristic  function 
of  the  probability  distribution  C.  The  distribution  G is  called 
strongly  non-lattice  by  Stone  (1965)  if  for  each  <S  > 0 

inf  1 1 - g(A) | > 0 . 

|A|>6 

Stone  shows  that  for  a strongly  non-lattice  distribution  with  an 
exponentially  small  tail  the  remainder  in  the  renewal  theorem 
vanishes  at  an  exponential  rate.  A uniform  version  of  this  result 
leads  to 


Theorem  2.  Assume  that  F (the  PQ  distribution  of  x ) is  strongly 
non-lattice.  Let  b -*•  00  and  0^  + 0 in  such  a way  that  S^b  - £ < 0. 
Then 


(29)  P (t  < °°}  = e"Ab(l-BA  + 62A2/2  + o(A2)  , 

0 

where  A=0  -0  and  6 = E_  s2  /2  F.ft  s . 

1 u 0 T+  0 T+ 

Proof.  A uniform  in  0j  version  of  Stone's  (1965)  result  (see  below) 

applied  to  the  P_  renewal  process  defined  by  s implies  that  for 
1 T+ 
some  r>0  and  all  smell  0^ 

E0  (s  -b)  - E s2  /2  E.  s + 0(e~rb)  . 

H1  T 91  T+  91  T+ 

The  argument  preceding  (26)  shows  that 


E 


e1(sr-b)' 


E0  ST  /3  E0  ST 
+ + 
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Substituting  these  results  into  (25)  and  using  Lemma  2 completes  the 
proof . 


For  the  most  part  the  required  uniformity  in  Stone's  result 
may  be  inferred  from  minor  modifications  in  his  argument.  The 
following  lemma  provides  some  of  the  necessary  technical  results. 


Lemma  5.  Assume  that  F is  strongly  non-lattice.  Then  the  P„  distri- 

butions  of  s are  strongly  non-lattice  uniformly  in  small  G > 0. 

T+ 

Also  there  exists  r > 0 such  that  for  each  6 > 0 EQ  exp(zs  ) is 

6 T+ 

bounded  away  from  1 in  0 < Rez  < r,  |z|  > <S,  uniformly  in  small  0 > 0. 

The  proof  follows  by  first  showing  that  the  Pg  distributions 
of  x^  are  uniformly  strongly  non-lattice  and  then  using  the  Wiener- 
Hopf  factorization  of  these  distributions  (Feller,  1966,  p.  570)  to 
show  that  the  Pg  distributions  of  s^  are  uniformly  strongly 
non-lattice.  The  details  have  been  omitted. 

Remark.  Although  (26)  is  "obvious,"  (29)  occurs  because  two  terms 
3 

involving  Eg  s^.  /Eg  st  cancel,  and  hence  is  somewhat  surprising.  It 

is  natural  to  ask  whether  this  phenomenon  might  persist,  i.e., 

3 

whether  the  remainder  in  (29)  is  -B  A / 3 ! + o(A  ).  That  this  is  not 

1 - lx  I 

in  genera]  true  may  be  seen  from  the  special  case  F(dx)  = ~ e ' 'dx, 

for  which  P~  {t<°°}  may  be  calculated  exactly.  See  Section  6. 

0 

Combining  the  preceding  results  with  the  identities 


(30)  P {s_>b)  = p Pfl  (t  < °°| s_}dP « 

90  T °0  {sT<a)  90  T 90 


[ 

I 


(31)  P (s  <a>  = Pfl  { t*  < 00 ) - / P {t*  < °°| s_}dP. 

fll  T 81  (sT>b)  91  T 91 

(t* = Inf {n  : < a})  yields  approximations  for  probabilities  such  as 

(2).  In  practice  |a|  is  frequently  0 (e.g. , cumulative  sum  control 
charts — see  van  Dobben  de  Bruyn,  1968)  or  of  the  same  order  of  magni- 
tude as  b (e.g.,  a symmetric  sequential  probability  ratio  test).  One 
example  of  the  possible  results  is  the  following. 

Theorem  3.  Suppose  a ■*  -00,  b ■+  °°,  and  0^  + 0 in  such  a way  that 
| a | /b  -*•  c € (0,°°)  and  O^b  - £ < 0.  If  F is  strongly  non-lattice, 
then 


(32)  P {s  >b} 
90  T 


= { 1 - exp [A(a  + a) ]}/{exp  [A(b  + P) ] - exp [A(a  + n) ] } + o (A  j 
Here  P = EQ  s^  /2  EQ  sT  and  a = EQ  s*  /2  EQ  st  . 

Proof . The  first  term  on  the  right  hand  side  of  (30)  is  given 
approximately  by  Theorem  2.  To  analyze  the  second  term  write 

f P0{T(b)  < »|sT}dPe 


{sT<a}  0 


[/ 


0 


+ f 


]P0  (s^,  € a - dx)Pg  (x(b  - a + x)  < °°} 


(0,  |a I**)  [ | a |^,°°)  90 

The  integral  over  [|a|^,°°)  is  majorized  by 

P0  (s  <a-  | a | **)  < Pfl  (T  > |a|5}  + Pfl  { sup  |xj  > | a 1 **> 
0 


' r'  n' 

° n<|a| 


1 


0( | a | — 3 ) = 0(A3)  , 
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and  hence  may  be  neglected.  The  proof  of  Theorem  2 shows  that 
uniformly  for  0 < x < |a|^ 

P„  {T(b  - a + x)  < °°}  = expf-  A(b  - a + x + 8)  1 + o(A2)  , 

0 

so  by  Lemma  1 

/ P„  (T(b)  < «>|s  }dPfi  = exp  f-  A(b  + 6)]P.  (s  < a}  + o(A2) 

{sT<a}  90  T 90  91  T 

Hence  by  (30)  and  Theorem  2 

Pft  ( s_  > b } = expf-  A(b  + 8) ]p_  {s  > b}  + o(A2) 

90  T 91  T 

A similar  argument  starting  from  (31)  yields  a second  relation  for 
PQ  (s  > b}  and  P«  (s  <a},  the  simultaneous  solution  of  which  gives 

90  T ei  T 

the  theorem. 

4.  Pg(T<m}  and  Pg(T<m,  sT  > b} 

The  following  interpretation  of  (28)  and  (32)  seems  helpful 
in  what  follows.  The  addition  of  a and  8 to  a and  b may  be  regarded 
as  a continuity  correction  to  be  made  in  replacing  the  discrete  time 
random  walk  fs^}  by  the  continuous  time  Brownian  motion  process.  The 
constant  A,  which  is  twice  the  absolute  value  of  the  mean  of  the 
approximating  Brownian  motion  process,  contains  a correction  for  non- 
normality of  the  random  walk.  If  the  x's  are  normally  distributed 

with  0 = Eq  x, , then  0.  = - ^ A and  0,  = \ A since  no  correction  for 
o 1 0 2 12 

non-normality  is  necessary.  (This  interpretation  oversimplifies 
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somewhat,  because  a and  8 are  distribution  dependent  and  hence  correct 
for  non-normality  as  well  as  continuity.) 

In  approximating  the  probabilities  (3)  and  (4)  the  situation 
becomes  more  complicated,  because  a more  elaborate  correction  for  non- 
normality is  needed.  This  correction  can  be  written  in  a fairly 
simple  form  by  keeping  the  preceding  interpretation  in  mind. 

For  the  sake  of  simplicity  only  the  one-sided  stopping  rule  T 

is  discussed  in  detail.  As  in  the  preceding  section,  b -*■  <•>  and  0 -*•  0 

2 

in  such  a way  that  0b  = -*■  £.  An  expansion  for  Eg  exp(-Ar/b  ) up 

to  terms  which  are  o(b  is  obtained,  and  this  expansion  is  formally 

inverted  to  give  an  approximation  to  Pg(T<b  t).  No  attempt  has  been 
made  to  justify  this  inversion,  although  it  is  natural  to  conjecture 
that  the  approximation  obtained  is  correct  up  to  terms  which  vanish 
faster  than  b 

3 2 

Theorem  4.  Let  y = E„  x„  , and  as  before  let  3 = E_  s / 2 E.  s 

0 1 0 T+  0 T+ 

Assume  that  b -*■  00  anc’  0 + 0 in  such  a way  that  0b  = -*•  £.  Let 

b 

h(A.O  = (2A  + S2)15  - £.  Then 

(33)  E0  exp(-AT/b2)  = exp [-h(A,£b) (1 + B/b) ] 

+ (6b)"1  yf2A  + C2-^3/(2A  + £:2)i5]exp[-h(A,0]+o(b"1)  . 

Proof . To  simplify  the  notation  assume  that  £ = £.  By  Lemma  1,  for 

0 > 0 

1 = P~{t  < «•}  = Eg  exp{ (0  - 0)sT  - T f(J)(0)  - \J>(9)  ]} 
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Replacing  0 by  0/b  and  9 by  £/b  gives 


exp[-(9  - O ] - Eg  exp{(O-O(sT-b)/b-Tfii)(0/b)  -i|<(C/b)]}  . 

2 3 4 

Using  the  expansion  i^(x)  = x /2  + \x  /6  + 0(x  ) (x -*•  0)  and  setting 
0 = (2A  + £2)  yields 


exp  [-h(A,0  ] = Eq  exp{h(A,C)(sT-b)/b-Ar/b^-Y(03-C3)T/6b',}  + o(b~i), 

which  by  Taylor  expansion  and  application  of  Lemma  3 and  uniform 
integrability  becomes 

E0{exp(-AT/b2)  [1  - y(93  - ^3)T/6b3] fl  + h(A,Q (sT  - b) /b]} + o(b_1) 


-Is 


Eg  exp(-AT/b2)  + Bb  1h(A,5)e~h(X,S) 


- (6b)  1 y(03-  ?3)  /“  t e"Xt  Pq{t  e b2  dt}  + o(b_1)  . 

By  (18)  this  last  integral  converges  to  - e and  hence 


Eg  exp (-At /b) 


= e_h(X,f;)(l  - Bb-1h(A,C))  + (6b)_1  y [2A  + £2  - £3/(2A  + S^le  h(X’C) 

+ o(b  S 

which  is  equivalent  to  (33). 

With  the  help  of  (17)  and  (18)  it  is  an  easy  matter  to  invert 
(33)  term  by  term.  Fowever,  some  additional  reflection  permits  one 
to  write  the  inversion  in  a simpler  form,  which  at  the  same  time 
seems  to  be  more  accurate  from  the  point  of  view  of  numerical 
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where  + A is  for  0 > 0 and  - A for  0 < 0.  Formal  inversion  now 
yields 

p0{T<b2t}  = G(t;  ±-|Ab,  1 + B/b)  + (3b)-1  y G'(t;£,l)  , 

which  is  consistent  with  (28)  for  t = + 00 . A yet  simpler 
approximation,  which  is  consistent  with  and  enlarges  upon  the  inter- 
pretation of  the  first  paragraph  of  this  section  follows  from  a 

further  approximation  of  this  last  expression  by 

-11  2 
G(t+(3b)  y;  ±^Ab,  1 + 8/6).  Rewriting  in  terms  of  m = b t yields 

finally 

(34)  PQfT<m}  S G(m+-|  Yb;  i^A,  b + B)  . 

This  result  has  the  Interpretation  that  to  compute  P0{T£ml  approxi- 
mately one  should  use  the  corresponding  result  for  a Brownian  motion 
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with  h replaced  by  b + fi  to  correct  (primarily)  for  continuity,  9 
replaced  by  t j A to  correct  for  non-normality  and  m replaced  by 
m + — yb,  also  to  correct  for  non-normality. 

A similar  but  more  elaborate  argument  yields  an  exactly 
analogous  approximation  in  the  case  of  two  barriers.  If  T denotes 
the  first  time  that  Brownian  motion  X ( t ) leaves  (a,b),  and 
G+(t;£,a,b)  = Pf{T<t,  X(T)=b},  then 

P^{T<m,  sT  > b)  = G+(m+-|yb;  ± A,  a+a,  b + 8) 


5.  Numerical  Computation  of  Moments  of  Ladder  Heights 

The  approximations  of  the  preceding  sections  involve  moments 
of  the  ladder  heights  s^  and  s^  . In  principle  the  characteristic 
functions  of  these  random  variables  are  available  from  random  walk 
theory,  and  hence  the  required  moments  may  be  calculated.  In  prac- 
tice results  have  been  obtained  only  for  special  problems.  In  a 
related  context  Woodroofe  (1978)  suggested  a general  method  based  on 
numerical  integration  of  the  characteristic  function  of  the  x's.  In 
this  section  Woodroofe's  method  is  adapted  to  the  problems  at  hand. 

By  the  duality  between  s and  s (Feller,  1966,  p.  570),  it 

T+  T- 

suffices  to  consider  only  s , from  which  the  corresponding  results 

T+ 

for  s^  may  be  directly  obtained.  According  to  Lai  (1976) 

(35,  vJ'Vt  - l 2*  I 2 E |.  |.  +iE0,J  . 

+ + n=0  L ' I -* 

where  n 1 Elsnl  a 0 for  n * 0.  Hence  it  is  necessary  to  compute 


20 


I 


i 


numerically  only  one  series  to  use  the  approximations  suggested  in 
the  preceding  sections. 

Let  f(t)  = Eq  expdtXj),  and  assume  that  f_m  | f (t)  |dt  < <*>. 

(This  assumption  can  be  removed  by  a simple  smoothing  argument.) 

Then  the  distribution  function  F has  a bounded  continuous  density 
given  by  the  Fourier  inversion  formula.  Let  f be  the  n-fold  convo- 
lution of  this  function,  so 

(36)  f n (x)  = (2tt)-1  /“  e"ltX  f°(t)dt  . 

The  series  in  (35)  equals 

00 

(37)  lim  lim  (2^(1  - z)"*5  - E n"1  z°  En|s  |exp(-X|s  |)}  . 

rt  W 1 n 

The  Fourier  inversion  formula  (36),  Fubini's  theorem,  and  some  calcu- 
lus gives 

En  * zn  Eq  | sn  | exp(-X  | s^  | ) = En  1zll/_oo|x|e  ^x^fn(x)dx 

= (2tt)-1  En"1  zn  /“[(X-bit)"2  + (X-it)~2]fn(t)dt 

= 2tt-1  /“  (t2-X2)(t2+X2)"2  Relog(l-zf(t))dt  . 

Observing  that  (t  -X  )(t  +X  )"  dt  = 0 permits  one  to  rewrite  this 
last  expression  as 

2tt—  1 /”  (t2-X2)(t2+X2)"2  Re  log  ( [l  - zf(t)  ]/(l  - z)  }dt 

= 2ti-1  /“  (t2-X2)(t2+X2)"2  Relogfl  + zfl  - f(t)  ]/(l  - z))dt  . 
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3 

Let  y = E0  x]  ' 


The  expansion  as  t •*  0 


(38)  1 + z 1 - f (t)  ]/(l  - z)  = 1 + -|z  (1  - z)"1t2fl+^  iyt+0(t2)] 


is  used  repeatedly.  To  evaluate 


1 im  f t2(t2+A2)  2 Re  log  (l+z[l-f(t)]/(l-z}dt  , 

A*0  U 


consider  the  integrals  over  (0,e)  and  (e,°°)  separately.  The 
expansion  (38)  shows  that  the  integral  over  (0,e)  may  be  made  arbi- 
trarily small  by  taking  e small  enough.  The  dominated  convergence 
theorem  applies  to  the  integral  over  (e,00).  Hence,  letting  A -*•  0 and 
then  e -*-0  shows  that  (39)  equals 


Sq  t 2 Re  log  (1  + z [l  - f (t)  ] / (1  - z)  }dt  . 


A similar  calculation  shows  that 


A2  f*  (t2  + A2)  2 Re  log  {l  + z[l-f(t)]/(l-z)}dt  -*•  0 


as  A + 0,  and  hence  it  suffices  to  evaluate 


(40)  lim[2?s(l  - z)-*5- 2Tr_1  t"2  Re  log  {l  + zfl  - f (t)  ]/(l  - z)  }dt  ] 

z-*-l 


Integration  by  parts  shows  that 


/Q  x 2 log(l  + x2)dx  = ir  , 


and  hence  (40)  may  be  rewritten 


lim  2tt_1  /“  t“2  Re  log  ( 1 + Z--1-  (1-  dt 

I l + tV2(l-z) 


Consider  the  intergrals  over  (0,c)  and  (£,“>)  separately.  The  expan- 
sion (38)  shows  that  for  t€  (0,f)  the  argument  of  the  logarithm  in 


(41)  equals 


1 - {fj  t2  + 0(t3/(l  - z))  ] / [l  + t 2 / 2 ( 1 - z)  ]}  . 


Hence,  from  the  Taylor  series  for  the  logarithm  one  sees  that  the 
integral  over  (0,e)  is  small  for  small  e.  By  the  dominated  con- 
vergence theorem  the  integral  over  (e,°°)  converges  to 


/"  t~2  Re  log  (2  [1  - f (t)  ]/t2}dt 


as  z -*■  1.  The  expansion  (38)  shows  that  the  integrand  is  bounded  at 
0.  Hence,  letting  e -*•  0 gives  the  result. 

(42)  Eqs2  /Eqst  - ^ EqxJ  - 2tt-1/“  t"1  Re  log  {2  [l  - f (t)  ]/t2}dt  , 


which  can  be  evaluated  numerically  in  many  concrete  cases. 


Remark.  The  corresponding  result  for  E„ s is 

0 T+ 

EQ  sT  = 2 * exp{ir  1 t 1 Im  log  [l  - f (t)  ]dt} 


6.  Numerical  Examples 

1 — I x I 

For  a simple  but  instructive  example  let  F(dx)  = e dx. 

It  is  easy  to  see  that  0^  = -9^,  so  A = 29^,  and  for  all  b > 0 and 

0 > 0 the  Pn  -distribution  of  s - b is  exponential  with  mean 
10  T 

1 - 1 1 

(1  - 2 A)  . Hence,  by  Lemma  1 applied  to  0q  and  9 
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P„  {t*-®}  = e-Ab(l  - | A)/(l  + ^ A) 

0 

2 

Also,  6 = EgS^  /2E^st  = 1 , so  (28)  becomes 

„ r , - -A(b+1) 

PQ  (t  < °°}  = e 

60 

The  relative  error  of  this  approximation  is  e A(1  A)/(l - ^ A)  - 1 = 

.01  for  A = .5.  In  this  example  Pg  {t < °°}  is  the  stationary  prob- 
ability that  the  waiting  time  exceeds  b in  a single  server  queue  with 
Poisson  input  of  intensity  (1-^A)  and  exponential  service  with  mean 
(1+-|a)  The  traffic  intensity  is  (1  - ^ A) /(I  + ^ A)  . The 

customary  diffusion  approximation  is  P_  {t < °°)  = e Ab,  which  is  valid 

0 

in  "heavy  traffic,"  i.e.,  for  A = 0.  For  A = .5  the  traffic 
intensity  is  .6,  which  is  far  from  heavy  traffic,  but  the  approxima- 
tion (28)  is  quite  good.  For  this  A the  uncorrected  diffusion 
approximation  has  relative  error  .67  and  doesn't  attain  1%  accuracy 
until  the  traffic  intensity  is  .99. 

For  a non-trivial  and  important  example  suppose  that  F = <J>. 
The  stopping  rule  T defines  a sequential  probability  ratio  test  for 
deciding  whether  a normal  mean  0 is  positive  or  negative.  Several 
quantities  similar  to  (4)  arise  in  studying  a truncated  version  of 
this  test.  They  have  been  computed  by  iterative  numerical  integra- 
tion by  Aroian  and  Robison  (1969).  The  preceding  section  suggests 
that  one  approximate  these  quantities  by  computing  their  analogues 
for  a Brownian  motion  process  with  stopping  boundaries  at  b + 0 and 
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a + a.  f t ts  easy  to  use  either  (35)  or  (42)  to  obtain 
6 = - c.  = R0sJ  /2Eqst^  = .583. 

Table  1 gives  the  results  of  several  exemplary  calculations. 

For  comparison  the  "exact"  results  of  Aroian  and  Robison  (1969)  are 
included  as  the  second  entry  of  each  cell.  In  some  cases  the  unmodi- 
fied diffusion  approximation  is  given  as  the  third  entry.  In 
general,  the  suggested  approximation  is  good  and  the  diffusion 
approximation  poor. 

Even  for  Brownian  motion  the  exact  formulas  for  the  quanti- 
ties in  Table  1 are  complicated,  and  it  is  worth  noting  that  simple 
approximations  suffice.  For  example,  if  X(t)  is  Brownian  motion  with 
drift  0 and  T = inf{t:  X(t)  t (a,b)},  then  (Ito  and  McKean,  1965, 
p.  31) 

Pn(T>t , X(t)  € dy}  = 2 T,  exp  [-n^7T^t/2(h-a)  ~ ]sin  sin  — dy/(b-a). 

u - d— a D-a 

r.=  l 

For  large  t,  all  terms  in  this  series  are  negligible  compared  to  the 
first,  and  hence  by  Lemma  1 as  t + ® 

Pq{T  > t ) = fh  P.{T>t,  X(t)  6dy}exp(0y  - 02t/2) 
o a 0 

~ exp (0a  - ~ 02t  [1  + Tr2/02(b-a)  2 ]}  [e^h  a^+l  ]sin  [tt  |a  | / (b-a)]— = ~ . 

1 7rZ  + 0Z(b-a)Z 

The  next  example  illustrates  the  accuracy  of  the  corrections 
for  non-normality.  Let  X^.X^,..-,  be  independent  and  exponentially 
distributed  with  expectation  A *.  Let  A^  • 1,  Aj  ■ 1.5  and 
A*  - (Aj  - A0)/log(A1/AQ)  - 1.233.  Let  sn  - n - A*  F."  XR  and 


1 

; 
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TABLE  1 

STOPPTNC  RULE  T WITH  a = -b;  NORMAL  VARIABLES 


" 

Parameters 

VT>"2> 

p0(t>|»2) 

p_e^T-<™1»  sT>b) 

+P  {T>m  , s >0} 
-o  I m^ 

Eq(T  A m^) 

b=5.889,  9= . 25 

m^=66,  m^=44 

.11,  .11,  .082 

.35,  .35,  .27 

.044,  .044 

35.7,35.9 

b=2.944,  6=.5 

m^  = m2  = 11 

.14,  .14,  .082 

.43,  .42,  .27 

.055,  .056 

8.1,  8.3 

T = first  n such  that  s^  t [a,b].  The  stopping  rule  T is  that  of  a 

sequential  probability  ratio  test  for  testing  A = Aq  against  A = A^. 

For  the  specific  chor.ce  -a  = 4.419,  b = 5.419  the  Wald  approximations 

to  the  error  probabilities  P.  (s  > b)  and  P.  {sT < a}  are  both  0.1. 

A0  T A1  1 

(Here  P^  denotes  probability  when  the  exponential  parameter  is  A and 
corresponds  to  but  is  not  identical  with  the  Pq  of  earlier  sections.) 
For  various  values  of  A^,  A^,  a and  b this  test,  usually  truncated, 
is  widely  used  in  quality  control  and  reliability  studies.  Numerical 
computations  of  its  exact  error  probabilities  as  well  as  various 
probabilities  of  the  form  (4)  have  been  carried  out  by  Epstein, 
Patterson,  and  Qualls  (1963).  These  latter  probabilities  are  of 
interest  in  studying  truncated  versions  of  the  test  and  in  the  theory 
of  confidence  intervals  following  sequential  tests  suggested  by 
Siegmund  (1978). 
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The  random  variable  -s  has  an  exponential  distribution  with 
mean  A*/A.  It  follows  easily  that  a = -1  and  0 = The  approxima- 
tion (32)  gives  P,  (s  > 5.419}  = .087  and  P.  {s  < —4 . 419 } = .101, 

A0  A1  1 

which  are  both  exact  to  three  decimal  places.  Table  2 compares  the 
approximate  value  of  (4)  recommended  in  Section  4 to  exact  values 
computed  by  F.pstein,  Patterson,  and  Qualls  (1963). 


TABLE  2 

SEQUENTIAL  TEST  OF  A = AQ(  = 1)  AGAINST  A = A^  = 1.5) 
WITH  a = -4.419  AND  b=  5.419 


PX(T<30,  sT>b}  2 

.060 

.259 

.620 

= 

.060 

.261 

.624 

PX(T<30,  sT<-a}  S 

.746 

.346 

.083 

> 

.751 

.351 

.084 
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